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(54) Training sequences for low-latency LMS Implementation 



(57) Use of a training sequence having terms that 
are orthogonal to each other are employed to consider- 
ably speed up execution of the LMS algorithm. Such or- 
thogonal sequences are developed for a channel that is 
described as a finite impulse response (Fl R) filter having 
a length from the already existing orthogonal train- 
ing sequences for at least two channels that have re- 
spective lengths and M^ each that is less than 
M new such that the product of M^ and Moke te equal 
to when M^ and have no common prime 
number factor. More specifically, a set of initial existing 
orthogonal training sequences is found, e.g., using 
those that were known in the prior art or by performing 
a computer search over known symbol constellations 



given a channel of length M. Thereafter, an orthogonal 
training sequence of length is developed, where 
the product of and M oU2 is equal to by re- 
peating the training sequence oldl number of 
times to form a first concatenated sequence and repeat- 
ing the training sequence old2 number of times to 
form a second concatenated sequence, so that both the 
first concatenated sequence and the second concate- 
nated sequence have the same length. Each term of the 
first concatenated sequence is multiplied by the corre- 
spondingly located term in the second concatenated se- 
quence which is placed in the same location in a new 
sequence made up of the resulting products. This 
new sequence is an orthogonal sequence of length 
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Description 
Technical Field 

s [0001] This invention relates to the art of training a receiver that receives signals from a channel that introduces 
noise and intersymbol interference, and in particular, to a system of generating the training sequence so that training 
may be performed using the least mean squares (LMS) algorithm with low latency. 

Background o? the Invention 

10 

[0002] A problem in the art of training a receiver that a) receives signals from a channel that introduces noise and 
intersymbol interference and b) which uses the least mean squares (LMS) algorithm, is that the high speed of compu- 
tation required to perform the LMS algorithm limits the transmission rate for data. Therefore, the prior art uses a small 
step size so that the computation is approximately the same as if the elements of the training sequence were orthogonal . 
« However, this approach leads to a coarser channel estimate, and the training takes longer than is desirable due to the 
small step size. 

Summary off the Invention 

50 [0003] I have recognized that if the terms of the training sequence could actually be orthogonal to each other then 
the LMS algorithm can be speeded up considerably. Some orthogonal sequences have been found, but these are 
limited to particular conditions, e.g., certain lengths or the modulation scheme for which they could be used do not 
correspond to conventionally used modulation arrangements. However, there has been no method to develop training 
sequences that indeed have orthogonal terms given the number of weights needed to property describe the channel 

25 as a finite impulse response (FIR) filter. 

[0004] Therefore, in accordance with the principles of the invention, I have devised a process by which an orthogonal 
training sequence can be developed for a channel that is described as a finite impulse response (FIR) filter having a 
length M^ from the already existing orthogonal training sequences for at least two channels that have respective 
lengths M oU1 and each that is less than M^ such that the product of M oid1 and is equal to M^ when 

30 M cai a™* M otd2 have no common prime number factor. More specifically, a set of initial existing orthogonal training 
sequences is found, e.g., using those that were known in the prior art or by performing a computer search over known 
symbol constellations given a channel of length M. Thereafter, an orthogonal training sequence of length M^ is 
developed, where the product of M^ and M^ is equal to M^ by repeating the training sequence oldl M^ number 
of times to form a first concatenated sequence and repeating the training sequence old2 M^ number of times to form 

35 a second concatenated sequence, so that both the first concatenated sequence and the second concatenated se- 
quence have the same length. Each term of the first concatenated sequence is multiplied by the correspondingly located 
term In the second concatenated sequence which is placed in the same location In a new sequence made up of the 
resulting M^ products. This new sequence is an orthogonal sequence of length M^. If there is more than one 
existing orthogonal sequence for a particular length channel, e.g., there may be different orthogonal sequences for 

40 different modulation schemes for the same length channel, the implementer may choose which ever orthogonal se- 
quence gives the results desired. Often, for practical applications, the result that yields the modulation scheme that is 
most suitable for use with the actual channel, which may yield the highest speeds, or the result that yields the smallest 
alphabet, which would reduce the hardware required for implementation, is desirable. 

[0005] Advantageously, a receiver using such an orthogonal training sequence may employ the optimum step size, 
45 resulting in the fastest training. 

Brte? Description of the Drawing 

[0003] In the drawing: 

so _ _ 

FIG. 1 shows, in flowchart form, an exemplary process for developing an orthogonal training sequence in accord- 
ance with the principles of the invention; and 

FIG. 2 shows an exemplary receiver arranged In accordance with the principles of the invention. 
5$ Detailed Description 

[0007] The following merely illustrates the principles of the invention. It will thus be appreciated that those skilled in 
the art will be able to devise various arrangements which, although not explicitly described or shown herein, embody 
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the principles of the invention and are Included within its spirit and scope. Furthermore, all examples and conditional 
language recited herein are principally intended expressly to be only for pedagogical purposes to aid the reader in 
understanding the principles of the Invention and the concepts contributed by the inventor(s) to furthering the art, and 
are to be construed as being without limitation to such specifically recited examples and conditions. Moreover, all 
5 statements herein reciting principles, aspects, and embodiments of the Invention, as well as specific examples thereof, 
are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such 
equivalents Include both currently known equivalents as well as equivalents developed In the future, i.e., any elements 
developed that perform the same function, regardless of structure. 

[CC08] Thus, for example, It will be appreciated by those skilled in the art that any block diagrams herein represent 
10 conceptual views of illustrative circuitry embodying the principles of the invention. Similarly, it will be appreciated that 
any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which 
may be substantially represented in computer readable medium and so executed by a computer or processor, whether 
or not such computer or processor Is explicitly shown. 

[0009] The functions of the various elements shown in the FIGs., including functional blocks labeled as "processors 0 , 

15 may be provided through the use of dedicated hardware as well as hardware capable of executing software in asso^ 
ciation with appropriate software. When provided by a processor, the functions may be provided by a single dedicated 
processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. 
Moreover, explicit use of the term "processor" or "controller 0 should not be construed to refer exclusively to hardware 
capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, 

50 read-only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage. Other hard- 
ware, conventional and/or custom, may also be included. Similarly, any switches shown in the FIGS, are conceptual 
only. Their function may be carried out through the operation of program logic, through dedicated logic, through the 
interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the 
Implementer as more specifically understood from the context. 

23 (0010] In the claims hereof any element expressed as a means for performing a specified function is intended to 
encompass any way of performing that function including, for example, a) a combination of circuit elements whtch 
performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with 
appropriate circuitry for executing that software to perform the function. The invention as defined by such claims resides 
In the fact that the functionalities provided by the various recited means are combined and brought together in the 

so manner which the claims call for. Applicant thus regards any means which can provide those functionalities as equiv- 
alent as those shown herein. 

[00111 Unless otherwise explicitly specified herein, the drawings are not drawn to scale. 

[0012] FIG. 1 shows, in flowchart form, an exemplary process for developing an orthogonal training sequence can 
be developed for a channel that is described as a finite Impulse response (FIR) filter having a length from already 

33 existing orthogonal training sequences for at least two channels that have respective lengths and each that 
is (ess than such that the product of and is equal to when ftfl^ and have no common 
prime number factor. The process is entered in step 1 01 when a new training sequence is required, e.g., when devel- 
oping a new wireless communication system. Next, in step 103, two already existing orthogonal training sequences 
oldl and oW2 for at least two channels that have respective lengths and each that is less than M^such 

40 that the product of and is equal to when and have no common prime number factor is 
selected. If It is not possible to find values such that the product of and is equal to e.g., is a 
prime number, then the process must terminate in an error condition. However, from a practical point of view, typically 
using a larger value of rather than the exact value of being sought will yield adequate results. 
[C313] The initial orthogonal sequences may be obtained by performing an exhaustive search over each possible 

45 combination for a particular modulation scheme's alphabet and a given channel length to determine the existence of 
an orthogonal training sequence. Wot all such searches will yield an orthogonal sequence, e.g., no such sequence has 
yet been found for a channel length of 13. Also, the time required to conduct each such searches may be quite long. 
Those orthogonal sequences that have been found to date are shown in Table 1 . In particular, Table 1 shows exemplary 
orthogonal sequences and the corresponding lengths and modulation schemes for which they were found. Note that 
.J?. — Tabl e 1a^^ 



TABLE 1 



Length 


Modulation Scheme 


Orthogonal Sequence 


M=2 


QPSK 


M 


M=3 


PAM 


-2,-2,1 


M=3 


V.29 


■3, 3+3j,3f3j 
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TABLE 1 (continued) 



Length 


Modulation Scheme 


Orthogonal Sequence 


M=4 


BPSK 


1.1.1.-1 


M=5 


No name 


2,2,2,2,-3 


M=5 


V.29 


-3f3j,-3j,-3+3j,3+3j,3+3j 


M=6 


PAM 


-1,1,-1,1,-1,-2 


M=6 


16QAM 


^3J,-l43j,-1-j,1^j l -1+3| r H 


M=6 


V.29 


3-3j,-3,3-aj I 3+3j,3j,3f3j 


M=7 


PAM 


-2,-2,-1,1,1,-2,1 


M=7 


V.29 


1-J»1-J,1-J,1iH.1i5j 


M=8 


QPSK 


1H.1 .-1.-1.1-1,-1 


M=9 


No name 


2,2,2,2,2,2,2,2,-7 


M=9 


PAM 


-2,-8,1,-2,1,1,-2,1,1 


M=9 


V.29 


-3-3J l ^3J ( 3,-3+3j i -3-3j,3+3|,3f3j,a*3J,3+3J 


M=10 


16QAM 


3-J i a+J.H-^J,1+3j,-H I -3H-1-J.l43|,-3+5j 


M=12 


PAM 


-2,-2,-2,-1,1,-2,-2,2,-2,1,1,2 


mi— 10 

IWI— 1 £. 


1 OVJ/\JVl 


^H. 1 "J. "-J.-1 i,l+oJ,3-3J f -3-j,-1 -j,-3f3j r 1 -j,1+3j,-3*3j 


M— 1 0 


DAM 


9 9 9< 901 1 O 4 O 4 4 4 4 

Z,-Z,-Z,l ,-Z,Z,l ,1 ,-Z,l ,2,1 ,1,1,1 


M=16 


QPSK 


11111 I -1 -i 1 -i 1 -1 1 -i -1 1 


M=18 


PAM 


2,-2,1 ,-2,1 ,1 ,-1.1 ,1 ,-2,-2,1 ,2,1 ,1 ,1 ,1 ,1 


M=18 


V.29 


^j,-34^j,3,-3^i,-3-3j,3+3j,34^,3^j t 3+3j,3^j, ^3j,3j,-^3j,3-3j,-3*3j,-3f3j,- 
3+3j,-343| 


M=19 


PAM 


-2,-2,1 ,2,-2,1 ,1 ,-2,-2,-2,-2,1 ,-2,1 ,-2,1 ,1 ,1 ,1 


M=21 


PAM 


-2,1 ,-2,1 ,1 ,1 ,1 ,-2,-2,1 ,1 ,-2,1 ,1 ,1 ,1 ,1 ,1 ,1 ,1 ,1 



[0014] Thereafter, in step 105, the training sequence oldl is repeated M^ number of times to form a first concate- 
nated sequence. Similarly, the training sequence old2 is repeated M oU1 number of times to form a second concatenated 
sequence, so that both the first concatenated sequence and the second concatenated sequence have the same length 
which is the desired sequence length M nowr For example, if is 3 using PAM and is 7 using PAM a sequence 
with length equal to 21 can be formed. Table 2 shows the concatenated sequence formed for M oU1 being 3 using 
PAM and M^ is 7. Table 3 shows is 7 using PAM and M^ being 3. 



Table 2 







1 






1 


-2 


-2 


1 


-2 


-2 


1 


-2 


-2 


1 


-2 


-2 


1 


-2 


-2 


1 


2 


2 




2 


2 



































Table 3 









1 


1 


: 2 


1 


-2 


-2 


-1 


1 


1 


-2 


1 


-2 


-2 




... L 


1 .... 






2 


2 


1 







































[001 5J In step 1 07, each term of the first concatenated sequence is multiplied by the correspondingly located term 
in the second concatenated sequence and the resulting product is placed in the same corresponding location in a new 
55 sequence made up of the resulting products. This new sequence is an orthogonal sequence of length M^ 
Table 4 shows the resulting new training sequence that is formed from the products of the terms of Tables 2 and 3, 
where M^ is 21 . Note that this new training sequence for M^ = 21 is different than the training sequence found by 
computer search for M=21 . 
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Table 4 



5 



4 


4 








-2 


-2 


4 


-2 


2 


-2 


1 


4 


-2 


-2 


4 


2 


1 


-2 


4 


1 






1 


2 


2 



































[0016] The process then exits in step 1 09. 

[0017] If there is more than one existing orthogonal sequence for a particular length channel, e.g., there may be 
different orthogonal sequences for different modulation schemes for the same length channel, the implementer may 
choose which ever orthogonal sequence gives the results desired. Often, for practical applications, the result that yields 
the modulation scheme that is most suitable for use with the actual channel, which may yield the highest speeds, or 
the result that yields the smallest alphabet, which would reduce the hardware required for implementation, is desirable. 
[0018] Table 5 shows several additional exemplary training sequences that were obtained using the procedures of 
the instant invention. 



Table 5 



M=14 


V.29 


n-HH-HH-iWrHH-nn-HH* 


M=20 




2^^,-2,-3,2^,-2^,-3^,-2^^,-3,-2,2,2,2,3 



[0019] FIG. 2 shows exemplary receiver 200 in accordance with the principles of the invention. Receiver 200 com- 
putes 



w w e(k-p\k-p) t 

pj) & p 

where X contains the M elements of the training sequence starting at time instant k-p, where k is the absolute time 
and p is the relative lag thereto, * means conjugate complex, and e0 is the error using and W is the channel 
estimate. Shown in FIG. 2 are a) parallel weight computers 201, including parallel weight computers 201-1 through 
201-M; b) adder 203, c) multiplier 205 and d) new weight vector producer 207. 

[0020] In order to enjoy a computation efficiency over the prior art, there are at least 2 parallel weight computers 
201 , and there are no more than M parallel weight computers 201 , where M is the channel length. Each of parallel 
weight computers 201 computes x e(Ar - pi* - p). To this end, each of parallel weight computers 201 receives the 
training sequence X and d(k) which if the actual received symbol at time k, as well as the latest value of the weight 
vector W. Note that, more particularly, e(WA) = d(A) - x T w k where T means transpose. Also note that X and W are 
vectors while d(k) is a scalar. 

[0021] Adder 203 sums the outputs of each of parallel weight computers 201 , I.e., each corresponding position of 
the vectors that are output by parallel weight computers 201 are summed. The summation vector produced as an 
output by adder 203 is supplied to multiplier 205 which multiplies each element of the summation vector by the step 
size ji, thus scaling the summation vector by The scaled summation vector is then supplied to new weight vector 
producer 207, which adds the scaled summation vector to the previously produced weight vector, which was stored in 
new weight vector producer 207, and supplies the resulting value as the new weight, as well as storing it. 
[0022] Note that the orthogonal sequences referred to herein as orthogonal training sequences need not actually 
ever have been used for training, although typically they are suitable for use as training sequences. Furthermore, the 
orthogonal sequences may be used for synchronization purposes. 



Claims 

^ ™ ~ ___.™ ur ....... 

1. A method for developing a new orthogonal sequence for a channel of length M^, the method comprising the 
steps of: 

^ selecting first and second existing orthogonal sequences okll and oW2 for at least two channels that have 

respective lengths and M^, the product of and being equal to and M old1 and 
having no common prime number factor; 

repeating the sequence oldl M oU2 number of fanes to form a first concatenated sequence; 
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repeating the sequence old2 M oM1 number of times to form a second concatenated sequence; 

multiplying each term in said first concatenated sequence by a correspondingly located term in said second 

concatenated sequence; and 

forming said new sequence by placing each product produced in said multiplying step into a corresponding 
location therein. 

2. The invention as defined in claim 1 further comprising the step of performing a search over each possible combi- 
nation for a particular modulation scheme's alphabet and a given channel length to determine the existence of an 
orthogonal sequence for use in said selecting step. 

3. The invention as defined in claim 1 wherein at least one of said first existing orthogonal sequence, said second 
existing orthogonal sequence, and said new orthogonal sequence Is employed as a training sequence. 

4. The invention as defined in claim 1 wherein at least one of said first existing orthogonal sequence, said second 
existing orthogonal sequence, and said new orthogonal sequence is employed as a synchronization sequence. 

5. The invention as defined in claim 1 wherein first and second existing orthogonal sequences each have a length 
that has no common prime number factor with the other. 

6. An new orthogonal sequence which is developed as a function of first and second existing orthogonal training 
sequences. 

7. The invention as defined in claim 6 wherein said new orthogonal sequence is for a channel of length M^, and 
said function for developing said new orthogonal sequence comprises the steps of: 

selecting said first and second existing orthogonal sequences okll and okt2 for at least two channels that have 
respective lengths and M^, the product of and M okC being equal to and M oU1 and 
having no common prime number factor; 

repeating the sequence oldt number of times to form a first concatenated sequence; 
repeating the sequence old2 M oU1 number of times to form a second concatenated sequence; 
multiplying each term in said first concatenated sequence by a correspondingly located term in said second 
concatenated sequence; and 

forming said new orthogonal sequence by placing each product produced in said multiplying step into a cor- 
responding location therein. 

8. The invention as defined in claim 6 wherein first and second existing orthogonal sequences each have a length 
that has no common prime number factor with the other. 

9. A receiver adapted for use with a new orthogonal sequence that was developed as a function of first and second 
existing orthogonal sequences. 

1 0. The invention as defined in claim 9 wherein said new orthogonal sequence is a training sequence and said receiver 
is adapted to use an optimal step size that results in fastest possible training. 

1 1 * The Invention as defined in claim 9 wherein said new orthogonal sequence is a training sequence and said receiver 
is adapted to use a step size = I / 1 X* | for training, where is a vector containing M elements of the training 
sequence and B \ | denotes the squared norm of \. 

12. The invention as defined in claim 9 wherein said new orthogonal sequence is for a channel of length M^, and 
: ^sajdfun^ . ... . 

selecting said first and second existing orthogonal sequences oldl and oH2 for at least two channels that have 
respective lengths and M^, the product of and being equal to and M oU1 and M oW2 
having no common prime number factor; 

repeating the sequence oldt number of times to form a first concatenated sequence; 
repeating the sequence old2 M okJ1 number of tines to form a second concatenated sequence; 
multiplying each term in said first concatenated sequence by a correspondingly located term in said second 
concatenated sequence; and forming said new orthogonal sequence by placing each product produced in 
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said multiplying step Into a corresponding location therein. 

13. The invention as defined in claim 9 wherein first and second existing orthogonal sequences each have a length 
that has no common prime number factor with the other. 



14. The invention as defined in claim 9 wherein said receiver computes 



where X contains M elements of said new orthogonal sequence starting at time instant k-p t where k is the absolute 
time and p is the relative lag thereto, * means conjugate complex, and e() is the error using X*-, W is the weight 
vector that represents the channel estimate, and p, is the step size. 

15. The Invention as defined in claim 9 wherein said receiver comprises: 

a plurality of parallel weight computers; 

an adder coupled to receive and add the outputs of said parallel weight computers; 

a multiplier for scaling by a step size a vector produced as an output by said adder; and 

a new weight vector producer for supplying as an output a new weight vector as a function of a previously 

produced weight vector and a scaled vector supplied by said multiplier. 
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